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Learning in Riemannian orbifolds is motivated by existing machine learn- 
ing algorithms that directly operate on finite combinatorial structures such as 
point patterns, trees, and graphs. These methods, however, lack statistical 
justification. This contribution derives consistency results for learning prob- 
lems in structured domains and thereby generalizes learning in vector spaces 
and manifolds. 



1 Introduction 

Statistical data analysis and learning in Riemannian orbifolds is motivated by applications, 
where the data we want to learn on are naturally represented by finite combinatorial 
structures such as point patterns, trees, and graphs. Examples from structural pattern 
recognition that learn on structured data include estimating central points of a distribution 
on graphs such as the mean and median [91 [161 (El EI] , central clustering of graphs [TOl HI 
H31 HU [191 OS E3] , learning graph quantization [T7j, and multilayer perceptrons for graphs 
[20] . In retrospect, the structure space framework proposed by [18] theoretically justifies 
the above approaches in the sense that they actually minimize an empirical risk function 
on structures. Since minimizing an empirical risk function is usually computationally 
intractable, the ultimate challenge consists in constructing efficient algorithms which are 
capable to return optimal or at least suboptimal solutions. 

From the point of view of statistical pattern recognition, however, the ultimate goal 
is not to determine a good solution of an empirical risk function, but rather to discover 
the true but unknown structure of the data with respect to its distribution. According to 
this perspective, we may regard the solutions of empirical risk functions as estimators of 
the true but unknown population parameter. One gap between statistical and structural 
pattern recognition is the lack of consistency results of existing estimators for the popu- 
lation parameters. As a consequence most methods from structural pattern recognition 
that directly operate in the domain of graphs still have no statistical justification. 
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The first contribution of this paper establishes sufficient conditions for consistency of 
estimators defined by empirical risk functions on attributed graphs. For this we regard 
graphs as points of some structure space [18]. A structure space is the quotient of a Eu- 
clidean space by some permutation group. The benefit of the structure space framework 
is that it provides enough mathematical structure for doing differential geometry and at 
the same time preserves the full relational information of the graphs. In comparison to 
|18j . the innovations are as follows: First, we extend the more suitable concept of gen- 
eralized differentiability in the sense of Norkin [22J to functions on graphs. Second, we 
prove the stronger result that the underlying empirical risk functions on graphs are gener- 
alized differentiable rather than locally Lipschitz. Third, equipped with these results, we 
apply a consistency theorem by Ermoliev and Norkin [8] for generalized differentiable loss 
functions. Finally, using some examples, we show that standard methods from statistical 
pattern recognition can be generalized to consistent learning algorithms on graphs. 

The second contribution shifts the terminology from structure spaces to the more gen- 
eral notion of orbifold. Informally, orbifolds are topological spaces locally modeled on 
quotients of manifolds by finite group actions. As such, structure spaces are the simplest 
examples of Riemannian orbifolds. Shifting the focus to orbifolds provides a new view 
on the problem with the following benefits: First, the notion of orbifold more strongly 
emphasizes the way we exploit differential geometric tools for graphs, namely via charting 
and lifting as in Riemannian geometry. Second, using the notion of orbifold integrates 
the structure space framework into an established mathematical field providing access to 
useful concepts, results, and insights. Third, the notion of orbifold indicates how the 
theory can be generalized to structures that locally live in a quotient of a manifold by 
some finite group action. Fourth, since orbifolds generalize Euclidean spaces and mani- 
folds, this framework not only establishes consistency for stochastic generalized gradient 
learning but also for standard stochastic gradient learning in Euclidean spaces (see [3]) 
under the unifying umbrella of learning on Riemannian orbifolds. 



2 The Problem of Learning on Graphs 

This section aims at outlining the problem of learning on structured data in order to 
motivate learning in Riemannian orbifolds. As an illustrative example, we consider the 
problem of estimating the mean of a distribution on attributed graphs. 

Attributed Graphs. We begin with describing the structures we want to learn on. Let 
A be a set of attributes and let e E A be a distinguished element denoting the null or 
void element. An attributed graph is a tuple X = (V, a) consisting of a finite nonempty 
set V of vertices and an attribute function a : V x V — > A. Elements of the set E = 
£ V x V : i ^ j and a(i,j) ^ e} are the edges of X. By Qa we denote the set of 
all attributed graphs with attributes from A. The vertex set of an attributed graph X is 
often referred to as Vx and its attribute function as ax- 



2 



Alignments. Alignments serve to compare the common structure of two given graphs. 
An alignment of a graph X is a graph X' with Vx Q Vx 1 an d 

r . .x jax(i,j) (i,j)eV x xV x 
I e otherwise 

Thus, we obtain an alignment of X by adding isolated vertices with null-attribute. The 
set Vy, = Vx'\Vx is the set of aligned vertices. By A(X) we denote the infinite set of all 
alignments of X. A pairwise alignment of graphs X and Y is a triple ((f), X' , Y') consisting 
of alignments X' G A(X) and Y' G A(Y) together with a bijective mapping 

4> '■ Vx' -tVyi, i !-> ^- 

A pairwise alignment (4>,X',Y') is minimal if </> does not map aligned vertices onto each 
other, that is <f>(V%,) C Vy. By .A(X,Y) we denote the set of all minimal pairwise 
alignments between X and Y. Note that A(X, Y) is finite due to the minimality condition. 
Sometimes we briefly write (j> instead of (4>,X' ,Y'). 



Graph Edit Distance. Dissimilarity is a fundamental concept in machine learning. Here, 
we consider the graph edit distance, which is a common choice for measuring structural 
variation of two given graphs. Several distance measures reported in the structural pattern 
recognition literature can be derived as special cases of the graph edit distance function. 
Examples are geometric graph distance functions [llj and distances based on the maximum 
common subgraph including graph and subgraph isomorphism [5]. 

To define the graph edit distance, we regard each minimal pairwise alignment ((j), X' , Y') G 
A(X, Y) as an edit path with edit cost 

d (f> (X',Y')= d A (a x ,(i,3),a YI (i*,j*)), 

where d A : A x A — > M+ is a distance function defined on the set A of attributes. The 
edit cost dtj, can be decomposed into deletion cost dA(a,s), insertion cost d^(s, a'), and 
substitution cost d^(a, a') of vertices and edges, where a, a' G -4 \ {e} are non-null at- 
tributes. Since dj^ is a distance function, we have dj^(e,e) = 0. This can only occur for 
pairs of non-edges by definition of minimal pairwise alignments and therefore can safely 
be ignored. Observe that deletion (insertion) of vertices also deletes (inserts) all edges the 
respective vertices are incident to. The graph edit distance of X and Y is then defined as 
the edit path with minimal cost 

d(X,Y)= mm {d^(X',Y') : (cj), X> , Y') G A(X, Y)} . 

The Problem of Learning. Let (Gai d) be a graph distance space. As an illustrative 
example, consider the expected risk 

R(W) = \ I d(X,WfdPg A (X), 
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where W £ W C Qj^ is the optimization variable and X € ^ is a random variable with 
probability distribution Pg A . Since the distribution on the set Qa of graphs is usually 
unknown, the goal of learning is to minimize the risk R{W) on the basis of empirical data. 

To point out the problems of learning in the domain of graphs, we consider the counter- 
part of minimizing the risk R(W) in a Euclidean vector space X. The goal is to minimize 
the expected risk 

R(w) = \ I \\x-w\\ 2 dP x (x), 
1 Jx 

based on independent and identically distributed random points xi,...,xn € X, where 

1 1 2 

Px is a probability measure on X. Since the loss function \\x — w\\ is continuously 
differentiate, the interchange of integral and gradient is valid, that is 

VR(w) = - (x- w)dP x {x). 
Jx 

We can minimize the risk R(w) using the following stochastic gradient method 

w t+ i = w t + -^-j (x t - w t ), 
where w\ = x\ and t > 1. The elements Wt of the sequence (wt)t>o ar e sample means 

1 * 

i=i 

It is well-known that the sample mean is a consistent estimator of the population mean 
which in turn is the unique global minimizer of the expected risk R(w). 

After this short digression in vector spaces, let us return to the problem of minimizing 
the expected risk R(W) in graph spaces. As opposed to vector spaces, the following factors 
complicate learning on graphs in a statistically consistent way: (i) the graph edit distance 
d(X, Y) is in general not-differentiable; and (ii) neither a well-defined addition on graphs 
nor the notion of derivative for functions on graphs is known. 

We therefore address the following questions: (i) How can we extend gradient-based 
learning problems from Euclidean spaces to Q jp- (ii) How can we minimize the expected 
risk of a learning problem with structured input- and/or output-space Qj± in a statistically 
consistent way? 

The ansatz to answer both questions is to identify graphs as points of a Riemannian 
orbifold and to extend the concept of generalized differentiability in the sense of Norkin 
|22j in order to apply methods from stochastic optimization for non-differentiable and 
non-convex loss functions. 

3 Riemannian Orbifolds 

This section introduces Riemannian orbifolds. To keep the treatment technically as un- 
cluttered as possible, we assume that X = W 1 is the n-dimensional Euclidean space, and 
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r is a permutation group acting on X. In doing so, we can refer to [18] for proofs of 
statements and claims made in this section. In a more general setting, however, X can 
also be a Riemannian manifold. In this case, we refer to [3] for more details. 

3.1 Riemannian Orbifolds 

The binary operation 

■-.TxX^X, (7,35)1-^7(05) 

is a group action of T on X . For x £ X, the orbit of x is the set defined by [x] = 
{7(2;) : 7 6 T}. The quotient set Xp = X /V = {[x] : x € X} consisting of all all or- 
bits carries the structure of a Riemannian orbifold. Its orbifold chart is the surjective 
continuous mapping 

7r : X -)■ Xp, x i-> [x] 

that projects each point a; to its orbit [x\. With T = {id} being the trivial permutation 
group, X is also an orbifold. Hence, orbifolds generalize the notion of Euclidean space and 
manifold. 

In the following, an orbifold is a triple Q = (X, T, tt) consisting of a Euclidean space X, 
a permutation group T acting on X and its orbifold chart tt. We call the elements of Xp 
structures, since they represent combinatorial structures such as graphs. We use capital 
letters X, Y, Z, . . . to denote structures from Xp and write x € X if tt{x) = X. Each vector 
x £ X is a vector representation of structure X and the set X of all vector representation 
is the representation space of Xp. 

3.2 The Riemannian Orbifold of Graphs 

Riemannian orbifolds of attributed graphs arise by considering equivalence classes of ma- 
trices representing the same graph. To identify graphs with points from some orbifold, 
some technical assumptions to simplify the mathematical treatment are necessary. For 
this, let (Gai d) be a graph distance space with graph edit distance d(-\-). Then we make 
the following assumptions: 

Al. There is a feature map $ : A — >• H of the attributes into some finite dimensional 
Euclidean feature space T-L and a distance function : rl x H — ^ M + such that $(e) = 
€ H and 

dA(a,a') = d H (®(a),®(a)) V a, a G A. 

A2. All graphs are finite of bounded order n, where n is a sufficiently large number. A 
graph X of order less than n, say m < n, is aligned to graph X' of order n by inserting 
p = n — m isolated vertices with null attribute e. 

Let us consider the above assumptions in more detail. Both conditions do not effect the 
graph edit distance, provided an appropriate feature map for the attributes can be found. 
Restricting to finite dimensional Euclidean feature spaces H is necessary for deriving 
consistency results and for applying methods from stochastic optimization. Limiting the 
maximum size of the graphs to some arbitrarily large number n and aligning smaller 
graphs to graphs of oder n are purely technical assumptions to simplify mathematics. 
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For machine learning problems, this limitation should have no practical impact, because 
neither the bound n needs to be specified explicitly nor an extension of all graphs to an 
identical order needs to be performed. When applying the theory, all we actually require 
is that the order of the graphs is bounded. 

With both assumptions in mind, we construct the Riemannian orbifold of attributed 
graphs. Let X = ~}{ nxn be the set of all (n x n)-matrices with elements from feature space 
%. A graph X is completely specified by a representation matrix X = (xij) from X with 
elements 

^ = \(p(a x (i,j)) i = j or (i,j) € E 
%3 1 otherwise 

for all i,j £ Vx- The form of a representation matrix X of X is generally not unique and 
depends on how the vertices are arranged in the diagonal of X. 

Now suppose that IT 1 be the set of all (n x re)-permutation matrices. For each P £ 11™ 
we define a mapping 

7P : X -> X, X ^ P T XP. 

Then T = {jp : P € IP} is a permutation group acting on X. Regarding an arbitrary 
matrix X as a representation of some graph X, then the orbit [X] consists of all possible 
matrices that can represent X. By identifying the orbits of Xy with attributed graphs, 
the set Q_a of attributed graphs of bounded order n is a Riemannian orbifold. 

3.3 Metric Structures 

Let Q = (X, r, 7r) be an orbifold. We derive an intrinsic metric that enables us to do 
Riemannian geometry. Note that in the case of graph orbifolds, the intrinsic metric is a 
special graph edit distance based on a generalization of the concept of maximum common 
subgraph. This graph metric occurs in various different guises as a common choice of 
proximity measure [Tl [61 171 [TT1 IM [25] . 

Any inner product (■, •) on X gives rise to a maximizer k : X-p x Xy — > K of the form 

k(X, Y) = max {{x, y) : x € X, y G Y} . 

We call the kernel function k(-\-) optimal alignment kernel, induced by (*,•). Note that 
the maximizer of a set of positive definite kernels is an indefinite kernel in general. Since 
T is a group, we find that 

k(X,Y) = max {(x,y) : x € X}, 
where y is an arbitrary but fixed vector representation of Y. 

Example 3.1 Suppose that X and Y are attributed graphs where edges have attribute 
1 and vertices have attribute 0. The optimal alignment kernel k(X,Y) induced by the 
standard inner product of X is the number of edges of a maximum common subgraph of 
X and Y. 
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Suppose that X € Xp. Since k(X,X) = (x,x) for all a; £ I, we can define the length 
of X by 

1{X) = y/k{X,X). 

Since the Cauchy-Schwarz inequality \k(X, Y)\ < l(X) ■ l(Y) is valid, the geometric inter- 
pretation of k(-\-) is that it computes the cosine of a well-defined angle between X and X' 
provided both are normalized. 

Likewise, &(•]•) gives rise to a distance function defined by 

d(X, Y) = v / l(X) 2 -2k(X,Y)+ l{Yy. 

From the definition of k{-\-) follows that d is a metric. In addition, we have 

d(X,Y) = mm{\\x - y\\ : x € X,y £ Y}, (1) 

where |j-|| denotes the Euclidean norm induced by the inner product (•, •) of the Euclidean 
space X. 

Equation (pQ) states that d(-\-) is the length of a minimizing geodesic of X and Y and 
therefore an intrinsic metric, because it coincides with the infimum of the length of all 
admissible curves from X to Y. In addition, we find that the topology of X-p induced by 
the metric d coincides with the quotient topology induced by the topology of the Euclidean 
space X. 

3.4 Orbifold Mappings 

This section introduces mappings between orbifolds and investigates local analytical con- 
cepts of orbifold functions. We assume that Q = (X,T,ir) and Q! = (X',T',ir') are 
orbifolds. 

Mappings. An orbifold mapping between Q and Q' is a mapping / : X? — > XL, between 
their underlying spaces. The lift of / is a mapping / : X — > X' between their representation 
spaces such that / o tt = n' o f. Since R is an orbifold of the form = (R, {id}, idu), we 
can define an orbifold function between Q and Qk as a function / : X-p — > R. The lift of 
/ is a function / : X — > R satisfying / = / o tt. The lift / is invariant under group actions 
of T, that is f(x) = f(rf(x)) for all 7 G T. 

We say, an orbifold function / : Xp — >■ R is continuous (locally Lipschitz, differentiable) 
at X E Xp if its lift / is continuous (locally Lipschitz, differentiable) at some vector repre- 
sentation x € X. The definition is independent of the choice of the vector representation 
that projects to X. 

Gradients. Suppose that / : Xp — > R is differentiable at X <E Xp. Then its lift / : X — >■ R 
is differentiable at all vector representations that project to X. The gradient V f(X) of / 
at X is defined by the projection 

V/pO = 7T(V/») 
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of the gradient V/(sc) of / at a vector representation x G X. This definition is independent 
of the choice of the vector representation. We have 

V/(7(a;)) = 7(V/») 

for all 7 € r. This implies that the gradients of / at x and 7(05) are vector representations 
of the same structure, namely the gradient V f{X) of the orbifold function / at X. Thus, 
the gradient of / at X is a well-defined structure pointing to the direction of steepest 
ascent. 

4 Generalized Gradients 

This section extends the concept of generalized differentiability in the sense of Norkin [22] 
to orbifold functions. We begin with introducing generalized differentiable functions. Let 
X = W 1 be a finite-dimensional Euclidean space. A function / : X — > M is generalized 
differentiable at x G X if there is a multi-valued map df : X — > 2 X in a neighborhood of 
x such that 

1. df(x) is a convex and compact set; 

2. df(x) is upper semicontinuous at x, that is, if j/j — > x and <7j G df{yi) for each 
i G N, then each accumulation point g of (gi) is in df(x); 

3. for each y G X and any g G df(y) holds /(t/) = /(a;) + (g,y — x) +0 (aj, y,g), where 
the remainder o(x,y,g) satisfies the condition 

lim K*^g;)l =0 

i— >oo — SB 

for all sequences yi — > y and G 9/ (yj). 

We call / generalized differentiable if it is generalized differentiable at each point a; G Af. 
The set df(x) is the subdifferential of f at x and its elements are called generalized 
gradients. 

Generalized differentiable functions have the following properties [22J: 

1. Generalized differentiable functions are locally Lipschitz and therefore continuous 
and differentiable almost everywhere. 

2. Continuously differentiable, convex, and concave functions are generalized differen- 
tiable. 

3. Suppose that /1, . . . , f n : X — > M are generalized differentiable at x G X. Then 

/*(sb) = min(/i(sE), . . . , f m (x)) and /*(se) = max(/i(sE), . . . , f m {x)) 
are generalized differentiable at x G X. 
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4. Suppose that fi,---,f m ■ X — >■ R are generalized differentiable functions at x G X 
and /o : R m -> R is generalized differentiable at y = (fi(x), . . . , f m (x)) G R m . Then 
/(x) = /o(/i(x), . . . , f m (x)) is generalized differentiable at x £ X. The subdifferen- 
tial of / at x is of the form 

<9/(x) =con|£ji G AT : # = [gig 2 • • • 3m]ff0, 00 6 df {y),gi G d/i(x),l < i < m\. 

where [f/i(/2 • • • ffm] is a (-W x m-)-matrix. 

5. Suppose that F(x) = K z [f(x, z)\, where /(•, z) is generalized differentiable. Then F 
is generalized differentiable and its subdifferential at x G X is of the form dF{x) = 
E z [df(x,z)\. 

Now suppose that / : X-p — > R is an orbifold function. We say / is generalized dif- 
ferentiable at X G Xy, if its lift / : X — >• R is generalized differentiable at all vector 
representations that project to X. The subdifferential df{X) of / at X is defined by the 
projection 

df(X) = 7t(9/(x)) 

of the subdifferential df(x) of / at a vector representation x G X. This definition is 
independent of the choice of the vector representation. We have 

3/(70*)) = 7(0/0*0) 

for all 7 G T. This implies that the subdifferentials df(x) C A" and df( r y(x)) C 
are subsets that project to the same subset of At, namely the subdifferential df(X). 
Proposition 14.11 summarizes and proves the statements. 

Proposition 4.1 Let f : At — > R 6e an orbifold function. Suppose that its lift f : X — >• R 
is generalized differentiable at a vector representation x that projects to X G At- XTiera / 
is generalized differentiable at 7 (x) for all 7 G T and 

df(l(x)) = 7 . 

is a subdifferential of f at "f(x) for all 7 G T. 

Proof: Since / is generalized differentiable at x, there is a multi-valued mapping df : 
Ug(x) 2 X defined on some neighborhood lA&(x). Let 7 G T be an arbitrary permutation 
and x' = 7 (x). Then 

df : U s (x') ^2 X , y' = 7 (y) ^ 7 

is a multi-valued mapping in a neighborhood of x'. Since 7 is a homeomorphic linear map, 
we find that j(df(x)) = df(x') is a convex and compact set. Next we show that / is 
upper semicontinuous at x'. Suppose that y[ — > x', g[ G f c (y'i) for each i G N, and g' 
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is an accumulation point of (^)ieN- Then there is a iq E N such that y\ £ U$(x') for all 
i > iq. Prom 

U s (x')=U 5 ( 1 {x)) = 1 (U s (x)) 

follows that there are vector representations y« <G U$(x) with 7(2/1) = y\ for each i > iq. 
From continuity of 7 _1 follows that j/j — > a;. By construction of df follows that 

g't e dfW = 9f(l(yi)) = 7 (df(vij) 

for each % > iq. Hence, there are vector representations gi e df(yi) with j(gi) = g[ for 
each i > iq. Since / is upper semicontinuous at x, we find that g £ df(x). Again by 
construction of df follows that 

9' = 7(9) G 7 (#/>)) = S/(7(a5)) = df(x'). 

This proves upper semicontinuity of df at all vector representations projecting to X = 
ir(x). Finally, we prove that / satisfies the subderivative property at x' . Suppose that 
y',y <G X with y' = j(y). By T-invariance of /, we have f(y') = f(y)- Since / is 
generalized differentiable at x, we find age df(y) such that 

f(y') = f(y) = fix) + {g,y- x) + o(x,y,g) 

with o(x, y, g) tending faster to zero than \\y — x\\ . Let g' = 7(9). Exploiting T-invariance 
of / as well as isometry and linearity of 7 yields 

f(y') = Kl(x)) + (i(g), 7(1/ - »)> + o(x, y, g) 
= />') + (g',y' - x') + o(x,y,g). 

We define o'(x',y',g') = o o 7 _1 (a; / , y', g') = o(x,y,g) showing that d tends faster to 
zero than \\y' — x\\. This proves the subderivative property of / at all vector represen- 
tations projecting to X = n(x). Putting all results together yields that / is generalized 
differentiable at j(x) for all 7 <G T. ■ 

Example 4.1 Let (GA>d) be a graph space, where d is a graph edit distance. We can iden- 
tify Qa with a Riemannian orbifold Q = (X,T,ir) and the graph edit distance d(-\-) with 
a distance function defined on X?. Suppose that the edit costs d^ (-|-) of all edit paths are 
generalized differentiable. Then the distance d{-\-) is generalized differentiable. 

Example 4.2 Let Q be a graph orbifold. Then the optimal assignment kernel fc(-|-), the 
intrinsic metric d(-\-), and the squared metric d(-\-) 2 are generalized differentiable. 

5 Stochastic Optimization 

We assume that Qyy = (W, H,p) and Qz = (Z,T,tt) are Riemannian orbifolds and 
C Wh is some (sufficiently large) bounded convex constraint set. Learning is formulated 



10 



as a stochastic optimization problem of the form 

min R(W) = E [L{Z, W)] = [ L(Z, W)dP r (Z) (2) 

Jz r 

s.t. w e n, (3) 

where R(W) is the expected risk function, W € f2 is the optimization variable, and Z G Zp 
is a random variable with probability measure Pp. The loss function L : Zp x — >■ R 
measures the performance of the learning system with parameter W given an observable 
event Z. We assume that the loss L{Z, W) is generalized differentiate in W and integrable 
in Z. The expectation E is taken with respect to some probability space (Zp, Er, Pp). 

Since the distribution Pz of the observable events Z E Z is usually unknown, the 
expected risk function R(W) can neither be computed nor be minimized directly. In addi- 
tion, the loss function L(W, Z) is neither convex nor differentiable. The field of stochastic 
approximation provides methods to minimize R(W) that are consistent under very general 
conditions. 

Since the interchange of integral and generalized gradient is valid, that is dwR(W) = 
E [d\yL(Z, W)] under mild assumptions [H [22], we can minimize the expected risk R(W) 
according to the following stochastic generalized gradient (SGG) method: 

W t+1 =Ha(W t -r h S t ), t>0, 

where Wq € £1 and is a projection operator on O. The random structures St are 
stochastic generalized gradients, i.e. random variables defined on the probability space 
(Zp, Sp, Pr)°° such that 

E[S t \Wo,...,Wt]edwR(W). (4) 

We can take St = g(Z t ,Wt) with iid (Z t ) t>0 and some single valued selection g(Z,W) € 
dy/L{Z,W), measurable in (Z,W). We consider the following conditions for almost sure 
convergence of the SSG method: 

Al The sequence {rjt)t>o of step sizes satisfies 

oo oo 

r] t > 0, lim 7] t = 0, V, Vt = °o, Y] Vt < °°- 
t=l t=l 



A2 The sequence (5 , t) i>0 satisfies 



A3 We have E 



\S t 



< +oo. 



Then by Ermoliev and Norkin's Theorem [8j, the SGG method is consistent in the sense 
that the sequence (Wt) t>0 converges almost surely to points satisfying necessary extremum 
conditions 

rr = {w e n ■. oe d w R{w)+M a {w)}, 
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where J\fn(W) is a normal cone to the constraint set 0, at W G Besides the sequence 
(/2(Wt)) t>0 converges almost surely and \\m t R{Wt) G -R(fT). 

Since orbifolds generalize Euclidean spaces and manifolds the consistency theorem is 
also valid for standard machine learning algorithms in Euclidean spaces with differentiable 
cost function (e.g multi-layer perceptron) and non-differentiable cost function (e.g. online 
k- means) [3]. 

6 Examples 

This section extends some typical examples of statistical data analysis and learning prob- 
lems from vector spaces to structured domains. We assume that Q = (X, T, ir) is a 
Riemannian orbifold with optimal alignment kernel &(•[•)• 

Orbifold-Adaline. Orbifold adaline generalizes the adaline proposed by [26] . 

Let W = Xt x R be the parameter space and let Z = Xt X {±1} be the space of 
observable data. The parameter space W consists of augmented parameter structures 
W' = (W, b), where W G Xt is the weight structure and b G M is the bias. The observable 
data Z = (X, y) from Z consists of input structures X G Xt together with their labels 

ye {±i}- 

The loss function of the orbifold- Adaline is of the form 

L ada (Z, W) = (y- (k(X, W) + b)f. 

Since k(-\-) is generalized differentiable, so is L a d a (Z,W). Lifting the loss L a d a to the 
Euclidean space gives 

Lada (z,w') = (y- max {(a/, to) : x' eX}-b) 2 , 

where z = (x,y) € Z and w' = (w,b) G W with vector representations x and y that 
project to structures X G Xt and W € Xt, respectively. The update rule is given by 

w t+ i =w t -rj t (y t - (x* t ,w t ) x* t ) 
ht+i = b t -T] t {y t - b t ), 

where (x*,wt) is an optimal alignment. 

Learning Orbifold Maps. This example presents a generic formulation of learning func- 
tional relationships between orbifolds in a supervised manner. Since orbifolds generalize 
Euclidean spaces, this setting covers various types of functional relationships that can be 
learned. Non-standard examples include multi-layer perceptrons for adaptive processing 
of graphs [20] and learning to predict structured data [2] . 

Let Qw = (yV,Q,ip), Qx = (X,T,tt), and Qy = (y,A,(/>) be Riemannian orbifolds. 
The parameter space is represented by orbifold Qyy and the space of observable data by 
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the orbifold Qz = Qx x Qy- Suppose that J 7 is a class of generalized differentiable orbifold 
mappings of the form 

The mean-squared-error loss function is defined by 

L mse (Z,W) = ^(Y-f(X,W)) 2 . 
Lifting this loss function yields 

1 / « \2 

L mse (z,w) = -{y - f(x,w)j , 

where z = (x, y) projects to structure Z = (X, Y) and w projects to W. The update rule 
is then of the form 

w t+1 =w t -7] t (y t - f(x t , w t j) g(x t , w t ), 

where g(x t ,w t ) £ dL mse (zt,w t ) is a stochastic generalized gradient of the lifted loss at 
w t . 

Structure Quantization. Structure quantization generalizes vector quantization to the 
quantization of structures. For graphs, a number of structure quantizer design techniques 
for the purpose of central clustering have already been proposed. Examples include com- 
petitive learning [T2J H3 H7] and k-means as well as k-medoids algorithms [TU1 HS1 125] . 

Let W = Xy be the parameter space and let Z = Xy- be the space of observable data. 
The parameter space W consists of fc-tuples W = {W\, . . . , Wk), called codebook. 

The general loss function of structure quantization is defined by the distortion 

L sq (X,W) = min d(X,W t ). 

l<i<k 

For generalized differentiable distance function d(-\-), the update rule is defined by 

w *+i = w *t -vg(xt,wt), 

where (xf, w t) ls an optimal alignment of input structure Xt and its closest codebook 
structure W£. If d(-\-) is the squared intrinsic metric, we have g(x,w*) = x± — w\. 

Observe that structure quantization also generalizes the problem of estimating a mean 
graph of Section 2.4 by fixing the number k of centroids to 1. 

7 Conclusion 

This contribution proves consistency of learning in structured domains by reducing it to 
stochastic generalized gradient learning on Riemannian orbifolds. The proposed framework 
is applicable to learning on combinatorial structures such as point patterns, trees, and 
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graphs. In retrospect, the proposed results provide a theoretical foundation and statistical 
justification of a number of existing learning methods that directly operate in the domain 
of graphs. In addition, the orbifold framework provides a generic technique to generalize 
gradient-based learning methods to structured domains. Future work aims at generalizing 
the theory to more general Riemannian orbifolds and to discontinuous graph edit distance 
functions. 
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